Pandas Profiling Report

Dataset statistics

Number of variables	8
Number of observations	284
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	10
Duplicate rows (%)	3.5%
Total size in memory	17.9 KiB
Average record size in memory	64.5 B

Variable types

Numeric	8

Alerts

Dataset has 10 (3.5%) duplicate rows	Duplicates
`Cement` is highly overall correlated with `Blast Furnace Slag _component_2` and 5 other fields	High correlation
`Blast Furnace Slag _component_2` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Fly Ash _component_3` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Water_component_4` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Superplasticizer_component_5` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Coarse Aggregate_component_6` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Fine Aggregate_component_7` is highly overall correlated with `Cement` and 5 other fields	High correlation
`Age_day` is highly overall correlated with `Water_component_4`	High correlation
`Blast Furnace Slag _component_2` has 105 (37.0%) zeros	Zeros
`Fly Ash _component_3` has 184 (64.8%) zeros	Zeros
`Superplasticizer_component_5` has 68 (23.9%) zeros	Zeros

Reproduction

Analysis started	2023-03-02 18:01:50.477320
Analysis finished	2023-03-02 18:02:00.846137
Duration	10.37 seconds
Software version	pandas-profiling vv3.5.0
Download configuration	config.json

Cement
Real number (ℝ)

Distinct	50
Distinct (%)	17.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	310.30106

Minimum	139.6
Maximum	540
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	139.6
5-th percentile	168
Q1	213.8
median	313.3
Q3	380
95-th percentile	475
Maximum	540
Range	400.4
Interquartile range (IQR)	166.2

Descriptive statistics

Standard deviation	99.981125
Coefficient of variation (CV)	0.32220685
Kurtosis	-1.0229998
Mean	310.30106
Median Absolute Deviation (MAD)	83.45
Skewness	0.25877377
Sum	88125.5
Variance	9996.2254
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
362.6	20	7.0%
425	20	7.0%
475	11	3.9%
251.4	10	3.5%
380	10	3.5%
139.6	6	2.1%
237.5	6	2.1%
332.5	6	2.1%
198.6	6	2.1%
427.5	6	2.1%
Other values (40)	183	64.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
139.6	6	2.1%
166.1	5	1.8%
168	5	1.8%
190	5	1.8%
190.3	5	1.8%
190.7	5	1.8%
194.7	5	1.8%
198.6	6	2.1%
212	5	1.8%
212.1	5	1.8%

Value	Count	Frequency (%)
540	2	0.7%
531.3	5	1.8%
485	1	0.4%
475	11	3.9%
469	5	1.8%
439	5	1.8%
427.5	6	2.1%
425	20	7.0%
401.8	5	1.8%
389.9	5	1.8%

Blast Furnace Slag _component_2
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	27
Distinct (%)	9.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	91.301056

Minimum	0
Maximum	282.8
Zeros	105
Zeros (%)	37.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	97.1
Q3	180
95-th percentile	233.75
Maximum	282.8
Range	282.8
Interquartile range (IQR)	180

Descriptive statistics

Standard deviation	84.654521
Coefficient of variation (CV)	0.92720199
Kurtosis	-1.1486138
Mean	91.301056
Median Absolute Deviation (MAD)	92.1
Skewness	0.34472113
Sum	25929.5
Variance	7166.3879
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=27)

Value	Count	Frequency (%)
0	105	37.0%
189	30	10.6%
106.3	20	7.0%
98.1	10	3.5%
47.5	6	2.1%
209.4	6	2.1%
237.5	6	2.1%
132.4	6	2.1%
142.5	6	2.1%
95	6	2.1%
Other values (17)	83	29.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	105	37.0%
38	4	1.4%
42.1	5	1.8%
47.5	6	2.1%
76	5	1.8%
93.8	5	1.8%
94.7	5	1.8%
95	6	2.1%
97.1	5	1.8%
98.1	10	3.5%

Value	Count	Frequency (%)
282.8	4	1.4%
262.2	5	1.8%
237.5	6	2.1%
212.5	5	1.8%
209.4	6	2.1%
200.9	5	1.8%
190	5	1.8%
189.2	5	1.8%
189	30	10.6%
177	5	1.8%

Fly Ash _component_3
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	16
Distinct (%)	5.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	37.855634

Minimum	0
Maximum	163.8
Zeros	184
Zeros (%)	64.8%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	96.7
95-th percentile	125.37
Maximum	163.8
Range	163.8
Interquartile range (IQR)	96.7

Descriptive statistics

Standard deviation	55.186615
Coefficient of variation (CV)	1.4578178
Kurtosis	-0.88374247
Mean	37.855634
Median Absolute Deviation (MAD)	0
Skewness	0.92242749
Sum	10751
Variance	3045.5625
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
0	184	64.8%
118.3	15	5.3%
121.6	10	3.5%
24.5	10	3.5%
100.4	10	3.5%
96.7	5	1.8%
94.6	5	1.8%
100.5	5	1.8%
125.4	5	1.8%
125.2	5	1.8%
Other values (6)	30	10.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	184	64.8%
24.5	10	3.5%
94.1	5	1.8%
94.6	5	1.8%
95.7	5	1.8%
96.7	5	1.8%
100.4	10	3.5%
100.5	5	1.8%
118.2	5	1.8%
118.3	15	5.3%

Value	Count	Frequency (%)
163.8	5	1.8%
163.3	5	1.8%
125.4	5	1.8%
125.2	5	1.8%
124.8	5	1.8%
121.6	10	3.5%
118.3	15	5.3%
118.2	5	1.8%
100.5	5	1.8%
100.4	10	3.5%

Water_component_4
Real number (ℝ)

Distinct	40
Distinct (%)	14.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	179.19965

Minimum	121.8
Maximum	228
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	121.8
5-th percentile	138.4
Q1	158.725
median	175.5
Q3	192
95-th percentile	228
Maximum	228
Range	106.2
Interquartile range (IQR)	33.275

Descriptive statistics

Standard deviation	28.882649
Coefficient of variation (CV)	0.16117581
Kurtosis	-0.65859819
Mean	179.19965
Median Absolute Deviation (MAD)	16.5
Skewness	0.38313739
Sum	50892.7
Variance	834.20739
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=40)

Value	Count	Frequency (%)
228	53	18.7%
164.9	20	7.0%
153.5	15	5.3%
192	14	4.9%
188.5	10	3.5%
181.7	10	3.5%
159.4	5	1.8%
159.3	5	1.8%
187.4	5	1.8%
186.7	5	1.8%
Other values (30)	142	50.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
121.8	5	1.8%
126.6	5	1.8%
137.8	5	1.8%
141.8	5	1.8%
144.7	5	1.8%
145.9	5	1.8%
146	1	0.4%
147.4	5	1.8%
151.4	5	1.8%
153.5	15	5.3%

Value	Count	Frequency (%)
228	53	18.7%
197.9	5	1.8%
195.5	5	1.8%
195.2	5	1.8%
192	14	4.9%
189.3	5	1.8%
188.5	10	3.5%
187.4	5	1.8%
186.7	5	1.8%
186	5	1.8%

Superplasticizer_component_5
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	35
Distinct (%)	12.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	8.3704225

Minimum	0
Maximum	32.2
Zeros	68
Zeros (%)	23.9%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	4.5
median	7.5
Q3	11.6
95-th percentile	23.19
Maximum	32.2
Range	32.2
Interquartile range (IQR)	7.1

Descriptive statistics

Standard deviation	7.2024219
Coefficient of variation (CV)	0.86046098
Kurtosis	1.3963984
Mean	8.3704225
Median Absolute Deviation (MAD)	4.1
Skewness	1.0696682
Sum	2377.2
Variance	51.874882
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=35)

Value	Count	Frequency (%)
0	68	23.9%
11.6	20	7.0%
16.5	15	5.3%
6.7	10	3.5%
5.7	10	3.5%
4.6	10	3.5%
7.8	10	3.5%
4.5	10	3.5%
6.1	5	1.8%
9.5	5	1.8%
Other values (25)	121	42.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	68	23.9%
2.5	2	0.7%
4.5	10	3.5%
4.6	10	3.5%
5.5	5	1.8%
5.7	10	3.5%
5.8	5	1.8%
6.1	5	1.8%
6.4	5	1.8%
6.7	10	3.5%

Value	Count	Frequency (%)
32.2	5	1.8%
28.2	5	1.8%
23.4	5	1.8%
22	5	1.8%
18.6	5	1.8%
16.5	15	5.3%
15.9	5	1.8%
14.3	5	1.8%
12.1	5	1.8%
11.6	20	7.0%

Coarse Aggregate_component_6
Real number (ℝ)

Distinct	36
Distinct (%)	12.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	966.67148

Minimum	852.1
Maximum	1134.3
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	852.1
5-th percentile	852.1
Q1	932
median	944.7
Q3	1028.4
95-th percentile	1088.1
Maximum	1134.3
Range	282.2
Interquartile range (IQR)	96.4

Descriptive statistics

Standard deviation	74.500208
Coefficient of variation (CV)	0.077068797
Kurtosis	-0.79422454
Mean	966.67148
Median Absolute Deviation (MAD)	59.9
Skewness	0.15870041
Sum	274534.7
Variance	5550.281
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=36)

Value	Count	Frequency (%)
932	53	18.7%
852.1	45	15.8%
944.7	30	10.6%
1028.4	10	3.5%
1047	7	2.5%
978.4	6	2.1%
1088.1	5	1.8%
1058.6	5	1.8%
1058.7	5	1.8%
1065.8	5	1.8%
Other values (26)	113	39.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
852.1	45	15.8%
884.9	5	1.8%
926.1	5	1.8%
932	53	18.7%
936	5	1.8%
942.7	4	1.4%
944.7	30	10.6%
946.8	5	1.8%
947	5	1.8%
949.9	5	1.8%

Value	Count	Frequency (%)
1134.3	5	1.8%
1120	1	0.4%
1090	5	1.8%
1088.1	5	1.8%
1085.4	5	1.8%
1066	5	1.8%
1065.8	5	1.8%
1058.7	5	1.8%
1058.6	5	1.8%
1057.6	5	1.8%

Fine Aggregate_component_7
Real number (ℝ)

Distinct	40
Distinct (%)	14.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	771.42077

Minimum	594
Maximum	992.6
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	594
5-th percentile	594
Q1	707.9
median	780.1
Q3	847.9
95-th percentile	905.585
Maximum	992.6
Range	398.6
Interquartile range (IQR)	140

Descriptive statistics

Standard deviation	99.102353
Coefficient of variation (CV)	0.12846731
Kurtosis	-0.57195314
Mean	771.42077
Median Absolute Deviation (MAD)	72
Skewness	-0.28134921
Sum	219083.5
Variance	9821.2763
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=40)

Value	Count	Frequency (%)
594	30	10.6%
755.8	30	10.6%
670	23	8.1%
887.1	15	5.3%
757.7	10	3.5%
803.7	10	3.5%
780.1	10	3.5%
806.9	7	2.5%
825.5	6	2.1%
785.5	5	1.8%
Other values (30)	138	48.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
594	30	10.6%
605	5	1.8%
611.8	5	1.8%
659.9	4	1.4%
670	23	8.1%
676	2	0.7%
707.9	5	1.8%
755.8	30	10.6%
756.7	5	1.8%
757.6	5	1.8%

Value	Count	Frequency (%)
992.6	5	1.8%
925.7	5	1.8%
905.9	5	1.8%
903.8	5	1.8%
903.6	5	1.8%
893.7	5	1.8%
887.1	15	5.3%
880.4	5	1.8%
870.3	5	1.8%
861.2	5	1.8%

Age_day
Real number (ℝ)

Distinct	12
Distinct (%)	4.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	66.616197

Minimum	3
Maximum	365
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.3 KiB

Quantile statistics

Minimum	3
5-th percentile	3
Q1	7
median	28
Q3	91
95-th percentile	270
Maximum	365
Range	362
Interquartile range (IQR)	84

Descriptive statistics

Standard deviation	86.406165
Coefficient of variation (CV)	1.2970744
Kurtosis	4.3911288
Mean	66.616197
Median Absolute Deviation (MAD)	25
Skewness	2.1753938
Sum	18919
Variance	7466.0253
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
28	56	19.7%
3	47	16.5%
56	43	15.1%
7	30	10.6%
91	22	7.7%
14	20	7.0%
100	20	7.0%
90	12	4.2%
180	12	4.2%
270	10	3.5%
Other values (2)	12	4.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
3	47	16.5%
7	30	10.6%
14	20	7.0%
28	56	19.7%
56	43	15.1%
90	12	4.2%
91	22	7.7%
100	20	7.0%
180	12	4.2%
270	10	3.5%

Value	Count	Frequency (%)
365	10	3.5%
360	2	0.7%
270	10	3.5%
180	12	4.2%
100	20	7.0%
91	22	7.7%
90	12	4.2%
56	43	15.1%
28	56	19.7%
14	20	7.0%

Auto

The auto setting is an interpretable pairwise column metric of the following mapping:

Variable_type-Variable_type : Method, Range
Categorical-Categorical : Cramer's V, [0,1]
Numerical-Categorical : Cramer's V, [0,1] (using a discretized numerical column)
Numerical-Numerical : Spearman's ρ, [-1,1]

The number of bins used in the discretization for the Numerical-Categorical column pair can be changed using config.correlations["auto"].n_bins. The number of bins affects the granularity of the association you wish to measure.

This configuration uses the recommended metric for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	Cement	Blast Furnace Slag _component_2	Water_component_4	Superplasticizer_component_5	Coarse Aggregate_component_6	Fine Aggregate_component_7	Age_day
0	540.0	0.0	162.0	2.5	1040.0	676.0	28
1	540.0	0.0	162.0	2.5	1055.0	676.0	28
2	332.5	142.5	228.0	0.0	932.0	594.0	270
3	332.5	142.5	228.0	0.0	932.0	594.0	365
4	198.6	132.4	192.0	0.0	978.4	825.5	360
5	266.0	114.0	228.0	0.0	932.0	670.0	90
6	380.0	95.0	228.0	0.0	932.0	594.0	365
7	380.0	95.0	228.0	0.0	932.0	594.0	28
8	266.0	114.0	228.0	0.0	932.0	670.0	28
9	475.0	0.0	228.0	0.0	932.0	594.0	28

	Cement	Fly Ash _component_3	Water_component_4	Superplasticizer_component_5	Coarse Aggregate_component_6	Fine Aggregate_component_7	Age_day
274	251.4	118.3	188.5	5.8	1028.4	757.7	3
275	251.4	118.3	188.5	5.8	1028.4	757.7	14
276	251.4	118.3	188.5	5.8	1028.4	757.7	28
277	251.4	118.3	188.5	5.8	1028.4	757.7	56
278	251.4	118.3	188.5	5.8	1028.4	757.7	100
279	251.4	118.3	188.5	6.4	1028.4	757.7	3
280	251.4	118.3	188.5	6.4	1028.4	757.7	14
281	251.4	118.3	188.5	6.4	1028.4	757.7	28
282	251.4	118.3	188.5	6.4	1028.4	757.7	56
283	251.4	118.3	188.5	6.4	1028.4	757.7	100

Most frequently occurring

	Cement	Blast Furnace Slag _component_2	Water_component_4	Superplasticizer_component_5	Coarse Aggregate_component_6	Fine Aggregate_component_7	Age_day	# duplicates
0	362.6	189.0	164.9	11.6	944.7	755.8	3	4
1	362.6	189.0	164.9	11.6	944.7	755.8	7	4
2	362.6	189.0	164.9	11.6	944.7	755.8	28	4
3	362.6	189.0	164.9	11.6	944.7	755.8	56	4
4	362.6	189.0	164.9	11.6	944.7	755.8	91	4
5	425.0	106.3	153.5	16.5	852.1	887.1	3	3
6	425.0	106.3	153.5	16.5	852.1	887.1	7	3
7	425.0	106.3	153.5	16.5	852.1	887.1	28	3
8	425.0	106.3	153.5	16.5	852.1	887.1	56	3
9	425.0	106.3	153.5	16.5	852.1	887.1	91	3

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

Duplicate rows

Most frequently occurring